Supplementary Materials
Performance and Feature Importance Report
An overview of this report
This report presents the performance and feature importance of prediction models of four outcomes:
- Past month heroin use
- Remission (long, medium, and short term)
- Overdose
- Mortality
Past month heroin use
HU_1YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.7343750 |
| sens | binary | 0.8548387 |
| spec | binary | 0.6212121 |
| f_meas | binary | 0.7571429 |
Feature Importance
HU_5YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.8264463 |
| sens | binary | 0.8333333 |
| spec | binary | 0.8187135 |
| f_meas | binary | 0.8355091 |
Feature Importance
HU_10YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.8489583 |
| sens | binary | 0.9408602 |
| spec | binary | 0.7626263 |
| f_meas | binary | 0.8578431 |
Feature Importance
Remission
STA_1YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.8695652 |
| sens | binary | 0.8952381 |
| spec | binary | 0.8431373 |
| f_meas | binary | 0.8744186 |
Feature Importance
STA_5YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.9055556 |
| sens | binary | 0.9007092 |
| spec | binary | 0.9108527 |
| f_meas | binary | 0.9087657 |
Feature Importance
MTA_5YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.7530864 |
| sens | binary | 0.8275862 |
| spec | binary | 0.6666667 |
| f_meas | binary | 0.7826087 |
Feature Importance
STA_10YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.8827839 |
| sens | binary | 0.9473684 |
| spec | binary | 0.8122605 |
| f_meas | binary | 0.8940397 |
Feature Importance
MTA_10YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.8209877 |
| sens | binary | 0.9806202 |
| spec | binary | 0.6403509 |
| f_meas | binary | 0.8532884 |
Feature Importance
LTA_10yr
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.7493540 |
| sens | binary | 0.7795699 |
| spec | binary | 0.7213930 |
| f_meas | binary | 0.7493540 |
Feature Importance
OD
OD_1YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.9125683 |
| sens | binary | 0.8736842 |
| spec | binary | 0.9545455 |
| f_meas | binary | 0.9120879 |
Feature Importance
OD_5YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.8633094 |
| sens | binary | 0.8497653 |
| spec | binary | 0.8774510 |
| f_meas | binary | 0.8639618 |
Feature Importance
OD_10YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.7619048 |
| sens | binary | 0.7777778 |
| spec | binary | 0.7460317 |
| f_meas | binary | 0.7656250 |
Feature Importance
Mortality
DEATH_10YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.8493827 |
| sens | binary | 0.8733850 |
| spec | binary | 0.8274232 |
| f_meas | binary | 0.8471178 |
Feature Importance
DEATH_15YR
Performance
| .metric | .estimator | .estimate |
|---|---|---|
| accuracy | binary | 0.8920765 |
| sens | binary | 0.8888889 |
| spec | binary | 0.8950131 |
| f_meas | binary | 0.8876245 |